Chat Template

POST 
/chat_template/:reader_id

Chat Template

The reader_id can be found as the model's key in the live_readers object, returned by the status endpoint. It can also be supplied at boot time for each model in the config: see here for more information.

Request

Path Parameters

reader_id stringrequired

The ID of the reader to use for tokenization.

application/json

Body

required

add_generation_prompt booleannullable
inputs array[]required

Responses

200

Takes in a JSON payload and returns the response all at once.

application/json

Schema

Schema

add_generation_prompt booleannullable
inputs array[]required

Example (from schema)

{
  "add_generation_prompt": true,
  "inputs": [
    [
      {
        "content": "string",
        "role": "string"
      }
    ]
  ]
}

400

Bad request

422

Malformed request body

503

The server is not ready to process requests yet.

Loading...